Minimal model of a heat engine: An information theory approach 
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We construct a generic model for a heat engine using information theory concepts, attributing 
irreversible energy dissipation to the information transmission channels. Using several forms for 
the channel capacity, classical and quantum, we demonstrate that our model recovers both the 
Carnot principle in the reversible limit, and the universal maximum power efficiency expression of 
nonreversible thermodynamics in the linear response regime. We expect the model to be immensely 
useful as a testbed for studying fundamental topics in thermodynamics. 
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Introduction. — The Maxwell's demon puzzle, suggest- 
ing a violation of the second law of thermodynamics, has 
been exorcised using Landauer's memory erasure princi- 
ple Treating the demon's intelligence as information 
has manifested a fundamental connection between infor- 
mation and physics, revealing the specific role of memory 
in terms of the second law of thermodynamics @. 

The goal of this paper is to suggest a minimal-universal 
model of a heat engine (demon) using information the- 
ory concepts, and to employ it for analyzing the oper- 
ation principles of finite-time thermodynamic machines 
Q. In our engine irreversible energy dissipation is at- 
tributed to information transfer within the demon's chan- 
nels, compensating entropy decrease in the system. The 
model serves as a testbed for studying fundamental top- 
ics in thermodynamics: The universality of the maximum 
power efficiency and its relationship to the Carnot effi- 
ciency. 

A central topic in thermodynamics is the study of the 
efficiency of thermal engines, manifesting universal fea- 
tures. According to the Carnot result the efficiency (work 
output over heat input) of a cyclic thermal machine, op- 
erating between two heat baths temperatures Tq and T# 
(lb < T H ), is at most 
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The upper limit is obtained for engines that work re- 
versibly. However, as reversible processes occur infinites- 
imally slowly, the power produced is zero. Operating 
away from equilibrium, a more practical question is the 
efficiency at maximum power, rj M , optimizing an engine 
cycle with respect to its power rather than efficiency. For 
a specific model, Curzon and Ahlborn (CA) derived the 
maximum power efficiency [|| 
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relaying on the endoreversible approximation in which 
the sole source of irreversibility is due to heat transfer 
processes [3]. Does © represent a universal character- 
istic of finite-time thermodynamics, or does it depend 
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FIG. 1: A schematic representation of the model heat engine, 
see description in the text. 



on the specific model? In the linear response regime it 
has been recently proven that the efficiency at maximum 
power is upper bounded by ©, which in this regime is 
exactly half of the Carnot efficiency @ . The upper limit 
is reached for a specific class of " strongly coupled" mod- 
els for which the energy flux is directly proportional to 
the work-generating flux. In contrast, in the nonlinear 
regime general results are missing, and expressions devi- 
ating from the CA efficiency were reported [f| 0] ■ 

In the present model irreversible loss of energy oc- 
curs at the communication channels, transmitting clas- 
sical information (entropy) from a heat source (Th) to 
the engine (Tc). We consider both classical and quan- 
tum channels, encoding classical information in quantum 
states, and show that in both cases Carnot efficiency 
can be achieved when the device works reversibly. We 
also demonstrate that in the linear regime (small tem- 
perature differences) the efficiency at maximum power 
is Tjc/2. Using a generic form for the channel capacity 
we show that an agreement to higher terms in ([2]) can 
be obtained for a class of channels. Our study indicates 
on the fundamental status of the (linear) CA efficiency 
in irreversible thermodynamics. We find that if a model 
obeys the Carnot limit for a reversible process, it must 
also follow, for a nonreversible operation, the universal 
behavior, t}m = ?7c/2 in the linear response regime, and 
vice versa. Moreover, we find that the ratio of 1/2 be- 
tween the maximum efficiency and the max-power effi- 
ciency holds even below the theoretical upper bounds, 
for imperfect systems. 
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Model. — Our model includes a finite subsystem im- 
mersed in a heat bath and an engine (demon), see Fig. 
[U In particular, the subsystem may include two discrete 
states and 1 of energies £n = and e\=e respectively. 
The subsystem is assumed to be tightly attached to a 
heat bath at temperature Th, thus in thermal equilib- 
rium the levels population follows the Boltzmann distri- 



bution Pq = 



_ expf-e/Tg) 



h = 1. 
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As the two level system (TLS) is virtually a part of the 
heat bath, we refer to the combined object as a heat 
source hereafter. It is important to note that the TLS is 
held in isothermal conditions: it is tightly connected to a 
large thermal reservoir at Th- Thus, the engine absorbs 
energy from the TLS, yet the TLS does not cool down 
to zero, as its temperature is kept fixed. This is analo- 
gous to the process of reversible isothermal expansion of 
ideal gases. We emphasize that our results do not depend 
on the particular choice of the subsystem, and the TLS 
model is introduced here as a simple demonstration. 

The right half of the plot shows an automatic ma- 
chine, referred to as the engine. It consists four compo- 
nents: detector, communication channel, processor and 
receiver. Following Shanon general model for a communi- 
cation system Q , in a working cycle the detector detects 
the state of the heat source, encodes it, and sends this 
information through the transmission channel to the pro- 
cessor which will decode it. Based on this information, 
the processor sends an instruction to properly set the re- 
ceiver, to accept the energy of the subsystem. While a 
measurement of the heat source state and receiving its 
energy can be done (virtually) without energy consump- 
tion [2j, energy dissipation in the engine is attributed 
to the transmission of information in the channels and 
the resulting setup of the receiver, corresponding to the 
Landauer erasure principle Q. 

Analysis of performance. — In each working cycle the 
engine needs to acquire the information on the state of 
the finite subsystem. The total amount of information 
that has to be absorbed during this process is given by 



(3) 



where, e.g., E = PqEq + P\£\ is the average energy of the 
TLS subsystem. This information has to be transferred 
through the engine communication channel. The mea- 
sure for a communication system is the channel capacity 
I p (S, No), describing the maximum number of bits that a 
system can communicate reliably per channel use. Here 
S and Nq (a function of Tc)are the pulse and noise av- 
erage energies, respectively [9j. In order to transfer I on 
the status of the heat source to the engine we need to 
invest energy 



Q= T s, 



(4) 



which cannot be refunded (else it contradicts the maxi- 
mum capacity theorem), thus this is the heat dissipated 



in the engine during an operation cycle. The engine effi- 
ciency is given by the amount of available working energy 
over the invested energy. Using W — E — Q for the work 
attained per cycle, we obtain 
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We will optimize the engine cycle (i) with respect to its ef- 
ficiency, minimizing Q, and (ii) with respect to its power 
P = W/n, where W — E — Q is the work attained per 
cycle. Here n = I/I p , the number of pulses that are 
needed to transfer the information / in a working cycle, 
is proportional to the period of the engine. Utilizing Eqs. 
© and (@} we get 



P = T H lp 



(6) 



Maximizing the power with respect to the pulse power S 
and substituting the optimal value Sm into ([5]) , provides 
the maximum power efficiency 



Vm = 1 - Sm/ThI p {Sm,T c ). 



(7) 



We consider next classical and quantum channels, derive 
rj for the two scenarios mentioned above, and manifest 
that they independently follow a universal behavior. 

Case I: Gaussian Channel. — Suppose we send infor- 
mation over a classical continuous memoryless channel 
of bandwidth B (measured in Hertz), subjected to an 
additive white Gaussian noise with a power spectral den- 
sity Nq. Assuming a signal power S, and taking BNo as 
the total noise power in a bandwidth B, one obtains the 

Shanon-Hartley capacity C = Bln(l + gj^j H- Defin- 
ing S = S / B as the average energy carried by the pulse 
and I p = C/B as a dimensionless capacity [|[ , we get 



I P = In I 1 
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In order to transfer the information / on the status of 
the subsystem into the engine we invest Q = J , s u . 

ln(l+7%) 

[see ([1J], identifying Ao = Tc as the thermal noise power 
spectral density. 

Carnot efficiency. — The minimum value of the last re- 
lation is Q = ITc, obtained when S — > 0, i.e., when the 
engine works reversibly with minimal energy consump- 
tion. As we invest Q and gain E, the net average energy 
gain of the engine is 



W = E - ITc = E (1 - Tc/Th) - 



(9) 



resulting in the maximal efficiency r/c = 1 — Tc /Th [io| ■ 
Maximum power efficiency. — We calculate r\u using 
the Gaussian capacity ((5J. The power ((6]) reduces to 



P = T H ln(l + S/T c )-S. 



(10) 



Taking ^ = yields the energy per pulse maximizing 



the power, S. 



Th — Tc- We substitute this result 
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FIG. 2: Maximum power efficiency for a heat engine of a 
narrowband bosonic channel with v = 0.2 (full) and v — 2 
(dashed). Tc = 1 was kept fixed. The CA efficiency and 
half of the Carnot limit are shown as dotted lines. Inset: 
Gaussian (dashed line), wideband bosonic (dotted line) and 
narrowband bosonic with v — 2 (full line) capacities, Tc = 1. 



into and obtain rjM = 1 — Sm/ Th In ( 1 
terms of the Carnot efficiency, r\c = 

rjc rjc In (I 
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For r\c — 1 1) the maximal power efficiency converges to 1. 
Note that the coefficient of the second (quadratic) term 
is smaller than the value recovered in several spatially- 
symmetric systems [TTj ] . 

Case II: Bosonic Channel. — We next send the same 
classical information, yet in the form of quantum states, 
over a memoryless quantum channel which is a bosonic 
field (e.g. an electromagnetic radiation): The mes- 
sage information is encoded into modes of frequency v 
and average photon number ub{v) (l2l. Il3j. The signal 
power is denoted by S; noise power is N = nT c /12h 
(l4| . Under the constraint that the message-ensemble- 
averaged energy of the channel is fixed, the capacity of 
this channel is given by C = ^(T e — Tc), where T e , 
the (effective) temperature of the decoder, is defined 

through the relation S + -p^fr = -j^fc, leading to C = 
2gf [(Uh£/irT c + l) 1 / 2 - 1] . Redefining I p = C/B and 
S = S/B; B denotes an effective bandwidth, we obtain 
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Remarkably, this capacity is inherently linked to the ther- 
mal conductance k of a ballistic quantum wire [l4| . 

Carnot efficiency. — We again minimize heat produc- 
tion in the channel Q = IS/I p , using (J3)) and f|12|). The 
minimum value of this expression is (A = 6Bh/n) 
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FIG. 3: Maximum power efficiency using different models for 
the information channel: Gaussian (dashed line), wide- 
band Bosonic (|12|) (dotted), compared to the Curzon-Ahlborn 
efficiency (full) and the Carnot efficiency (dashed-dotted line). 



retrieving the Carnot limit, r\c = (E — Qs^o)/E = (1 — 
Tc/Th). 

Maximum power efficiency. — Maximizing P, we ob- 

' 'm 2 



tain Sm = 
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We plug it into © and 



exactly resolve only the linear term 
Vm/vc = 1/2. 



(14) 



Interestingly, this result holds in both the high temper- 
ature limit, when the classical Shanon capacity is recov- 
ered I p = S/Tc, as well as at low temperatures when 
quantum effects become important and the channel ca- 
pacity approaches I p — \J ttS/SHB. 

We proceed and explore a narrowband photon chan- 
nel, B v, where v is the channel central frequency. In 
this case the noise power is given by N = hvusiv^ Tc)B; 
ub{v,T) — [e hv / T — 1] _1 is the Bose-Einstein distribu- 
tion. Based on the assumption that photon noise is ad- 
ditive, the (dimensionless) capacity I p — C/B fulfills @ 



I p = In 



x In 



^-^(l-e^/^) 
hv 



S + hvnsiy, Tc) 



[S/hv + n B (v,T c )] 
- n B {v,Tc)hv/T c . (15) 



Since analytical results are cumbersome, we acquire 
Sm numerically, seeking the intersect of 1/Tjj with 
dI p (S)/dS, see Eq. The results, displayed in Fig. 

[21 clearly demonstrate that t)m is bounded by r\cA from 
above, and that t]m — Vc/2 in the lowest order of AT/T. 
Interestingly, the results are almost independent of the 
channel central frequency v. The inset displays chan- 
nel capacities for the three models considered: Gaussian, 
wideband and narrowband bosonic channels. Figure [3] 
further shows the maximum power efficiency rjM for the 
classical and quantum wideband channels, as a function 
of r)c, compared to the CA and the Carnot efficiencies. 
We find that the CA value is an upper bound for t]m- 

Case III: Generic Channel. — Motivated by the 
classical-Gaussian channel and the quantum models, we 



4 



consider next a general form for a channel capacity, 

I p = ax + (3x 2 +jx 3 + 0(x 4 ). (16) 

Here x = S/Tq is the signal power over noise, and the 
parameters a, f3 and 7 may depend on Tc- These coeffi- 
cients are constricted so as to produce positive capacity, 
I p > 0. Assuming I p is a concave function, valid for the 
cases investigated above, the inequality 37s* < —/3Tc 
must be satisfied. Since S > and 7 > [so as 
I P (S ^> 0) > 0], we conclude that /3 must be negative. 
In particular, for the Gaussian channel ([5]) a power ex- 
pansion gives a = 1, = — 1 and 7 = 4/3, while for 
the bosonic wideband quantum channel we get a = 1, 
(3 = -Sh/nTc and 7 = I8h 2 / 'n 2 T£ . Using the generic 
form (|16p . the maximal efficiency is obtained by mini- 
mizing heat production, Q — IS/I p , resulting in 



Q(S -> 0) = IT c /a; V = Vc/a, 



(17) 



where fjc = f]c + 01 — 1. Thus, in order to reach the 
Carnot limit one must require that a = 1. Next, still 
using the form (|16|) we maximize P and obtain the pulse 
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Plugging this 
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leads to 
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(18) 



Imposing a = 1 results in 



Vm/vc = \ + ^ (1 - 7/2/3 2 ) + Ofag.). (19) 

The following important observations can be made: (i) 
The Carnot limit 77c = {T H - T C )/T H and the effi- 
ciency at maximum power tjm — (at nrs t order 
in rjc) are non-subordinate elemental results in thermo- 
dynamics: Demanding that a = 1 for channels working 
at maximal capacity, independently produces both the 
Carnot efficiency, and the universal linear coefficient in 
Eq. p^|) . (ii) A universal relation between the two ef- 
ficiencies stands still even below the upper bound: As- 
suming that a < 1 accounts for loss mechanisms in the 



channel, operating below its full capacity, the maximal 
efficiency of the engine is given by fj/a, while the max- 
imal power efficiency (in linear response) is exactly half 
this value, fj/2a. (iii) The first (linear) term in (fT5|) is 
independent of the details of the channel model, j3 and 
7. (iv) Finally, the (lack of) universality in the quadratic 
term of tjm has been a source of debates [TT|. Our anal- 
ysis exposes that this coefficient depends on the details 
of the channel, i.e., on the relations between the nonlin- 
ear terms. In particular, if 7 = 2/3 2 the quadratic term 
diminishes, in agreement with the quantum (wideband) 
bosonic channel. When A0 2 = 37, it reduces to 77^. / 12, 
as in the classical Gaussian channel. For 7 = /3 2 the 
quadratic term becomes 77^/8, recovering the CA result 
@ and other symmetric models 

Summary. — We have designed here a minimal model 
of a heat engine (or a Maxwell's demon), attributing en- 
ergy dissipation within the machine to irreversible loss of 
energy within the engine communication channels. Ana- 
lyzing both classical and quantum information channels 
we have demonstrated that our model satisfies the Carnot 
limit for reversible operation mode. Independently, it 
leads to the universal linear term in the maximum power 
efficiency, exhibiting the existence of fundamental laws 
for finite-time thermodynamic processes. While the uni- 
versality of the maximal power efficiency in the linear re- 
sponse regime has been explained based on the Onsager's 
symmetry Q , our model establishes this universality de- 
veloping a distinct, information based picture. We expect 
this prototype model to be immensely useful for studying 
other basic concepts in thermodynamics. For example, 
the engine described here could serve as a cooling de- 
vice, or the performance could be analyzed for a subsys- 
tem away from the Boltzmann distribution. One could 
also advance the model beyond the strong coupling limit, 
W oc E [l!|, or consider other sources of dissipation. Fi- 
nally, it is of great interest to further include quantum 
effects, considering transmission of quantum information. 
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